Cleaning and Validation
Last Updated: May 19th, 2026
In May 2026, an updated version of the raw data was provided in a different format than the version exported in July 2023 and provided in the summer of 2025. As a result, data processing was split into two paths: one for the 2023 format and one for the 2026 format.
The 2026 versions of comparable sections should be treated as the most current method applicable for ongoing research. Insights from the 2023 format are assumed to apply to the 2026 format as well. Unexpected outcomes or shortcomings in algorithm performance identified in the 2023 drafts were used to inform improvements applied in the 2026 version.
Analysis Outline
The analysis outline and motivating preamble provided in Cleaning and Harmonization - 2023 Format apply here. Process improvements or modifications identified during the initial 2026 format assessment are noted in Review - 2026 Format.
Code Optimization
Notes regarding code optimization steps taken for High Performance Computing (HPC) usage are provided in the Cleaning and Harmonization - 2023 Format page.